EVALDA-CESART Project: Terminological Resources Acquisition Tools Evaluation Campaign

نویسندگان

  • Widad Mustafa El Hadi
  • Ismaïl Timimi
  • Marianne Dabbadie
چکیده

This paper describes the ongoing evaluation work in CESART research project supported by the French Ministry of Research and Technology and coordinated by the University of Lille 3 and ELDA. The project deals with the evaluation of term and semantic relation extraction from corpora in French. CESART logically follows on the evaluation project achieved within the framework of the Concerted Research Project ARC A3 supported by the AUF, former Aupelf-Uref. This article sets the context, briefly mention the project objectives and reports on the suggested evaluation protocol. 1 http://www.technolangue.net 2 The ARC A3 is a project of the ILEC group coordinated and founded by AUF 1996-2000. The project aim was to test software capabilities in term and semantic relation extraction from corpora in French (cf. Béguin, et al., 2000; Jouis et al., 1997; Mustafa El Hadi et al., 1998; 2001).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Terminological Resources Acquisition Tools: Toward a User-oriented Evaluation Model

This paper describes the work achieved in CESART (Campagne d’Evaluation des Systèmes d’Acquisition des Ressources Terminologiques) evaluation project supported by the French Ministry of Research and Technology1 and coordinated by the University of Lille 3 and ELDA. The project deals with the evaluation of term and semantic relation extraction from corpora in French. CESART logically follows on ...

متن کامل

Results of the French Evalda-Media evaluation campaign for literal understanding

The aim of the MEDIA-EVALDA project is to evaluate the understanding capabilities of dialog systems. This paper presents the MEDIA protocol for speech understanding evaluation and describes the results of the June 2005 literal evaluation campaign. Five systems, both symbolic or corpus-based participated to the evaluation which is based on a common semantic representation. Different scorings hav...

متن کامل

The French MEDIA/EVALDA Project: the Evaluation of the Understanding Capability of Spoken Language Dialogue Systems

This paper presents and reports on the progress of the EVALDA/MEDIA project, focusing on the recording and annotating protocol of the reference dialogue corpus. The aim of this project is to design and test an evaluation methodology to compare and diagnose the context-dependent and independent understanding capability of spoken language dialogue systems. Systems from both academic organisations...

متن کامل

Data, Annotations and Measures in EASY the Evaluation Campaign for Parsers of French

This paper presents the protocol of EASY the evaluation campaign for syntactic parsers of French in the EVALDA project of the TECHNOLANGUE program. We describe the participants, the corpus and its genre partitioning, the annotation scheme, which allows for the annotation of both constituents and relations, the evaluation methodology and, as an illustration, the results obtained by one participa...

متن کامل

The Ongoing Evaluation Campaign of Syntactic Parsing of French: EASY

This paper presents EASY (Evaluation of Analyzers of SYntax), an ongoing evaluation campaign of syntactic parsing of French, a subproject of EVALDA in the French TECHNOLANGUE program. After presenting the elaboration of the annotation formalism, we describe the corpus building steps, the annotation tools, the evaluation measures and finally, plans to produce a validated large linguistic resourc...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004